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ABSTRACT 


This paper describes a system to perform real time onboard geometric correc- 
tion of Landsat D resolution satellite imagery. System requirements, algorithms, 
sensors, and other hardware components are defined, Feasibility of implement- 
ing the correction process is demonstrated using Kalman filter techniques to in- 
corporate information from onboard epheitieris (GPS), attitude control (MACS) 
and ground control points. Random access sensor systems, such as Charge In- 
jected Devices (CID) and Charge Coupled Devices (CCD), are used to obtain 
pixel values at desired ground locations, thus greatly reducing the data process- 
ing requirements. 
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The results presented are from a study that is currently in progress to 
extend and further develop an alternate approach to performing geometric 
image correction and registration using a technique conceived in a pre-^ 
vious study performed by 6E (Ref. 1) (See Figure 1). 

A brief overview of the need for geometric image compensation is pro- 
vided followed by an explanation of the alternate approach. A dis- 
cussion of possible implementation approaches for this new concept is 
provided followed by the development of a conceptual design based on 
current Landsat-0 requirements (for baseline purposes only) (See Figure 2), 

For the purposes of this presentation, we classify geometric image disr 
tortions as deterministic or non-deterministic (See Figure 3). The det- 
erministic errors are assumed to be known apriori and removed by appro- 
priate processing. Only the non-deterministic or time varying errors 
related to such items as alignments variation, ephemeris uncertainty, 
attitude control pointing errors, sensor distortion or warping and map- 
ping projections transformations must be identified and compensated as 
the data becomes available. The magnitude of these effects can vary over 
wide ranges such as the ephemeris determination usinq GPS (10 meters) 
to the uncertainty from the standard ground tracking system (256 meters). 
Even with such improvements, the anticipated achievable accuracy is still 
several hundred meters and the required performance less than 10 meters. 
Investigation and previous experienoe have indicated that by using ground 
control point (GCP) correlation the desired accuracy can be achieved. 

The Landsat-C and proposed Landsat-D geometric image correction and reg- 
istration approaches both utilize resampling and interpolation to per- 
form the correction function (See Figure 5). A real-time operating 
environment eliminates or severely restricts the ability to use resampl- 
ing techniques. The proposed alternate approach ("Smart Sensor") uses 
an over-sampled two-dimensional image plane and a Kalman filter-driven 
direct readout controller to eliminate the need for interpolation and 
resampling. The level of over-sarapl ing is selected to provide an accept- 
able level of error using the nearest neighbor approach. 

The differences between the approaches currently in use and the "Smart 
Sensor" can be vividly seen by considering an example where the center 
of the output pixel is not on the input or measurement data grid (See 
Figure 4). To obtain the value of the output pixel, a horizontal inter- 
polation must first be performed to construct several values along the 
output grid line on which the desired pixel lies. These constructed points 
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are then used to perform an interpolation in the vertical direction to 
obtain the desired value. In the "Smart Sensor" approach, the high 
density of sub-pixel detector elements coupled with the correction co- 
efficients derived from the Kalman filter allows the value at the des- 
ired point to be read out directly. Improvements in the achievable 
signal-to-no1se ratio can be obtained by utilizing the output of several 
detectors centered about the desired point. 

Several trade off studies were conducted to establish a preferred approach 
(See Figure 6 and 7). The "push broom" (MLA) or a long cross track 
image plane that is moved along the ground track by the spacecraft velocity 
was found to be preferred to a "whisk broom" (Thematic mapper) approach, 
since it eliminates the errors associated with mirror scan repeatibility 
( 7 meters RMS) , potentially one of the largest Landsat-D error sources, 

and is not S/N or sampTing rate constrained. 

The "push broom" approach may be implemented using either a one (linear) 
or two (matrix) dimensional array of detectors (See Figure 8). The matrix 
approach was determined to be superior, since it eliminates the need for 
large buffer memories, significantly reduces the amount of software pro- 
cessing required to construct a pixel, and is not oversample or sub-pixel 
limited along-track by maximum sample rate signal-to-noise considerations. 
Re-set residuals can be eliminated by using double correlated reads, how- 
ever, this increases the sampling rate by a factor of two. The main area 
of concern is whether fabrication technology will be available to allow 
the manufaeturing of such large scale detector arrays. 

These detector arrays can be implemented using photo diodes, charge coupled 
devices (CCD) or charge injection devices (CID) (See Figure 9). Although 
there are many similarities, the CID appears to offer the most direct or 
easiest implementation. The photo-diodes require additional circuitry to 
provide a select read capability which effectively produces a 100 micro- 
meter spacing. In addition, the use of a buffer memory is necessary to 
provide a non-destruct multiple detector per pixel read capability. The 
CCD can be operated in a time delay integration mode to improve the S/N 
but this effectively converts the two dimensional array into a single 
dimension. Thus, this feature cannot be utilized in the current config- 
uration. Investigations have indicated that it might be possible to 
operate a CCD in the Random access non-destruct read mode but this capabil- 
ity is yet to be fully demonstrated. 

The "Smart Sensor" approach appears to be compatible with real-time on- 
board implementation (See Figure 10). The recursive nature of the Kalman 
filter sample controller minimizes to quantity of data which must be stored. 
The question as to the number and frequency of the ground control points 
required to provide acceptable imaging errors when a new swath is started 
is yet to be investigated. Trade offs between the number of filter states 
and the number and frequency of ground, control points must be investigated. 
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The upper part of the block diagram is essentiany a top level repre- 
sentation of the multi-mission attitude control system (MMACS). 

Evaluating whether GCP correlation errors can be integrated into the 
MMACS is no trivial task. The first cut approach would probably be 
to operate these two recursive filter in a semi -independent mode while 
making the output states of each filter available for use in the other. 

The primary benefit of improving overall attitude control system point- 
ing performance appears to be associated with auxiliary experiments 
and not geometric image correction of the primary sensor* 

The geometric correction matrix will be based on the Landsat-n confi- 
guration without the two states associated with the scan mechanism. 

Based on previous experience, the size of the GCP reference image has 
been chosen to be 32 x 32 30 Meter Pixels. Due to the accuracy re- 
quired, the output of the detectors will probably have to undergo radio- 
metric correction to issue proper GCP selection. 

Landsat-0 requirements were used to develop an application example in 
order to insure that a complete set of realistic and consistent speci- 
fication which reflect current thinking were available. This example 
is intended to characterize the main features of the approach and high- 
light some of its salient characteristics (See Figure 11). To meet 
the specified requirements and provide direct read-out of a scan line, 
approximately a 6000 by 20 pixel array would be required to provide the 
ground swatch coverage necessary to account for the maximum errors along- 
track. An 8 x 8 array of detectors per pixel is required to meet the 
arbitrary error budget allocations indicated. The values were selected 
to provide a maximum uncertainty in the recursive filter since its 
characteristic and convergence properties are not yet defined. The array 
size or focal plane size appears to be the limiting item for this confi- 
guration. 

Several sub-studies or analyses were conducted to provide parameterie 
data on key design parameters (See Figure 12). The required number of 
detector cells to obtain a desired accuracy using the nearest neighbor 
approach is based on a uniform distribution RMS error allocation. The 
Geometric Correction Matrix (GCM) error contribution to cross track error 
is the result of comparing the actual value with the estimated value for 
30 and 90 grid points while varying the time intervals between GCM up- 
dates. The signal-to-noise ratio for the CID read out approaches con- 
sidered, assumed a simplified signal-noise model consisting of the number 
of carriers due to photons, dark current and amplifier noise. The two 
extremes were investigated consisting of one set of read out electronics 
shared among 11 CID chips and one set of electronics per CID chip. The 
actual design implemented will probably lie somewhere between these two 
extremes. The depth of the detector array for yaw attitude error is de- 
rived from straightforward geometric considerations. 

Present technology indicates that a CID chip will contain at least 1000 x 
1000 detector cells (See Figure 13). The depth of 1000 cells is more than 
adequate to account for the worst case variations along track. The main 
challenge lies in the cross-track layout since for the specified confi- 
guration 48,000 detectors or 48 chips are required. The CID chip has 
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inherently a non-conducting border which prevents the detectors on 
adjacent chips from being directly abutted. There are several ap- 
proaches which can be used to circumvent this problem. One way is to 
use a front to back staggered layout as indicated. This approach 
produces a fixed known along track displacement error which is 
deterministic. Based on the arbitrary error allocation of one (1) 
meter for pixel precision placement, an oversample factor of 8 is 
required. This oversample factor leads to an image plane size of 
48 cm. 

There are several approaches available for reducing the size of the 
required image plane (See Figure 14). If a re-evaluation of the error 
budget indicates that the recursive filter uncertainty can be limited 
to 3.67 meters then 2.0 meters could be allocated to pixel placement 
precision. This 2 meter requirement reduces the oversampling factor 
to 4, thus cutting the image plane size in half; Alternately, if the 
error budget were increased to 4.64 meters RMS or the multiple pass 
pixel to pixel registration requirement eliminated, the required per- 
formance could be achieved with an oversampling factor of 4, Other 
parameters which are directly proportional to the required number of 
detectors or image plane size are the swath width and pixel size or 
resolution. Thus, reducing the swath width to 90 KM or increasing 
the pixel size to 60 x 60 meters or some combination of these two 
parameters could be used to reduce the required image plane to ap- 
proximately 20 cm. 

The tasks remaining to be investigated include the definition of the 
recursive filter, the accuracy achievable and required computational 
capability associated with a specific design, the required number and 
spacing of GCP points to minimize data loss while the filter is con- 
verging to its steady state value (See Figure 15). 
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REALTIME ON-BOARD GEOMETRIC 
IMAGE CORRECTION 
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Figure 1 
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• REQUIREMENTS 

• "SA/IART SENSOR" CONCEPT 

• IMPLEMENTATION APPROACH 

• CONCEPTUAL DESIGN 

• SUMMARY AND CONCLUSIONS 

Figure 2 
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• SOURCES 

- VIEWING GEOMETRY (NON-SYSTEMATIC) 

ALIGNMENT - 206. 4 METERS 

EPHEMERIS - 10 TO 256 METERS 

ATTITUDE CONTROL - 175.2 METERS 

- SENSOR 

- MAPPING 

• LANDSATD REQUIREMENTS 

- GEODETIC: 

0.5 PIXEL (90%) - 9. 12 METERS (RMS) 

- REGISTRATION 

0. 3 P IXEL (90%) - 6. 08 METERS (RMS) 

- OPERATIONAL 

6.08/\/2 - 4.3 METERS (RMS) 


GROUND CONTROL POINT CORRELATION IS REQUIRED 


Figure 3 
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• CURRENT (LANDSAT C) 

- TWO DIMENSIONAL POLYNOMIAL CONSTRUCTION 

- RE-SAMPLI NG AND I NTERPOLATI ON 


• LANDSAT-D 

- GEOMETRIC CORRECTION AAATRIX GENERATED FROM A 
17 STATE KALMAN FILTER 

- RE-SAMPLING AND INTERPOLATION 

• "SMART SENSOR" 

- OVER-SAMPLED TWO DIMENSIONAL IMAGE PLANE 

- KALIVIAN FILTER-DRIVEN DIRECT READOUT CONTROLLER 


"SAAART SENSOR" APPROACH ELIMINATES RE-SAMPLING 

Figure 4 
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INPUT 

GRID 


OUTPUT 

GRID 


DETECTOR 

CELL 

Figure 5 
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• SCANNING MECHANISMS AND CONFIGURATION 

- WHISK BROOM VS PUSH BROOM 

- LINEAR (WITH STORAGE) VS MATRIX 

• TECHNOLOGIES 

- CCD 

- CID 

- PHOTODIODE 

Figure 6 
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t WHISK-BROOM 

- SMALL IMAGE PLANE 

- SMALL NUMBER OF DETECTORS 

- RAPID SAMPLING (~10j[(S/16 PIXELS) 

- MIRROR SCAN REPEATABILITY ERRORS (~7M RMS) 

• PUSH-BROOM 

- LONG IMAGE PLANE 

- LARGE NUMBER OF DETECTORS 

- DETECTOR OUTPUT VARIATION (RADIOMETRIC CALIBRATION) 

- SLOW PARALLEL SAMPLING (~4 ms/PIXEL) 

- NO MOVING MECHANICAL ASSEMBLIES 


PUSH BROOM ELIMINATES THE LARGEST SOURCES OF ERROR 


Figure 7 
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Figure 8 




CHARGE COUPLED DEVICES (CCD) 
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Cl D OFFERS EASIEST IMPLEMENTATION 
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TRANS- 

MISSION 





MISSION REQUIREMENTS 

- 708 KM ORBIT 

- 185 KM SWATH 
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Figure 1 1 




REQUIRED NUMBER OF DETECTOR CELLS TO OBTAIN 
A DESIRED ACCURACY USING NEAREST NEIGHBOR 



I 

Of 




o 


r-“ 

3 



QC 


O 



o 


Q 



Oi 

Qi 

1 

O 

S 



LU 

Qi 

DC 



^ Oi 

h— 

2: 

O 



S 

o 

P 



J— oc 

o 



< DC 
g LU 

LU 

3 

DC 

o 

LL 


J 



£ 


LU 

X 

£ <c 

H- q; 

1=: 

h- 

< 

DC 

LU 

OO 

g (/I 

LU 


CL 

LU 

fc 

S 

o H- 

ctc y2, 
S OO 

o ^ 

^ o 

< 

s 

3 

O 

3 

O 

£ o 

O 

o 

O 

cn 

QC 

H- ^ 


H- O 

< 



— J ^ 

o 

Cc£ 

i 

si 

1 

< o 

Q. 


o tr 


o 

Q- 


LU 3 


— D_ 

< 


O CQ 


, CO < 


<NJ 


o 


OO 

CNJ 

• 

o 

tu 

o 


Q 

< 

O' 


CO 

E 

u\ 

m 

uu 


e ^ 


< 

ct; 

o 

LU 


LU 

Q 

,3 


1 =: 

< 


c 

>- 

Qi 

O 

LU 

>• 

< 

Cel 

QC 

Cel 

O 

1 — 

a 

tu 

Q 

U- 

O OO 

CL OC. 
^ Qi 
O LxJ 


CN 


3 

< 

OO 

Lui 

O 

< 


oc 

LU 


LU 

X 

a_ 

QC 


X :§ 

UTN ^ 
OO O 

r-i cn 


43 



6N OR 48 CM 
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THE REQUIRED IMAGE PLANE COMPATIBLE WITH MLA DESIGN 









REDUCE NUMBER OF ELEMENTS PER PIXEL 

- RE-ALLOCATE ERROR BUDGET (EX: KALMAN-*-3. 67 M) 

- INCREASE ERROR BUDGET 

REDUCE NUMBER OF PIXELS 

- REDUCE SWATH WIDTH 

- REDUCE RESOLUTION 


Figure 14 
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ON-BOARD COMPUTATIONAL REQUIREMENTS 



SUMMARY AND CONCLUS IONS 
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SEVERAL KEY ANSWERS NEEDED TO DETERMINE EFFECTIVENESS 



